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RECORDING MEDIUM WITH ITS PROGRAM RECORDED 

(57)Abstract: 

PROBLEM TO BE SOLVED: To execute information 
provision following the interests of a viewer according to 
the instruction or reproducing situation with respect to a 
video or a subject of the viewer at the time of executing 
information provision by a hyperlink technology. 
SOLUTION: The preliminarily set and defined effective 
condition of link information with respect to a scene in a 
video or a subject is stored in the link information table 
of a link information storing part 106. An information 
storing part 104 extracts the reproducing situation of 
the video at that time by using an instruction input 
(input event) with respect to the each scene in the 
video or the subject as a chance. A retrieving part 105 
retrieves the effective condition of the link information 
of the link information table from the input event and the 
extracted reproducing situation of the video, and 
retrieves the effective link information. An event control 
part 108 decides an effective link from the retrieved 
result, and presents or displays relevant information or 
action information to be presented which is defined in the decided link information in a relevant 
information storing part 107 at a video display part 102, or executes it. 
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SPECIFICATION <EXCERPT> 

[0025] 

Furthermore, FIG. 3 shows a storage example in the link 
information storage unit 106. Here, the row ID 1 shows that an 
action of displaying a still image having a file name of "objectl.jpg" 
is associated with an object indicated by a rectangle (a rectangle 
having coordinates (50, 100) and (300, 400) as its diagonal apexes) 
in the video, and this link is enabled when the original video is 
reproduced at a reproduction speed of less than 0.5 (for example, 
less than 15 frames per second). Furthermore, the row ID 2 shows 
that the same object as that of ID 1 is associated with a reproduction 
of a moving image having a file name of "object2.mpg", and the 
enabling condition of the link is that the image is reproduced at a 
reproduction speed of 0.5 or more (for example, 15 flames or more 
per second). Similarly, in ID 3, an action is defined for a certain 
temporal segment in the video, and in ID 4, another action is defined 
for an object having meta-information of "Maruyama Batsuko 
(translator's note: this only shows an example of a person's name)" 
attached thereto. Respective enabling conditions for ID 3 and ID 4 
are: "when the reproduction is performed at a normal speed (for 
example, 30 frames per second)", and "when a viewer doubles the 
size of the object". 
[0026] 

The reproduction control unit 101 can reproduce video 
information on the video display unit 102 while changing its size and 
reproduction speed freely. The input unit 103 accepts a user input 
such as an input from a pointing device like a mouse, and a speech 
input from a speech input device. 
[0027] 



Now, suppose that video information is reproduced at a 
reproduction speed of 1.0. At this time, if a user specifies a point on 
the screen (for example, a point having coordinates (100, 200) on 
the display screen) at a given time (tO), then the information 
extracting unit 104 obtains the reproduction state such as a 
reproduction position, a display size, or a reproduction speed of the 
video being reproduced in the video display unit 102. Here, 
information such as the time tO, 10 display frames, the reproduction 
speed of 1.0, and the specified coordinates (100, 200) is obtained. 
[0028] 

The search unit 105 resets the details of the user input 
received in the input unit 103 and the display status of the video at 
that time which is obtained by the information extraction unit 104, 
and searches link information which is created and stored in the link 
information storage unit 106 beforehand. 
[0029] 

In the example of FIG. 3, the objects of ID 1 and ID 2 meet the 
condition, but ID 3 and ID 4 are excluded from the target for the 
display frame information and the meta-information. In addition, 
as to ID 1 and ID 2, since the reproduction speed of the moving 
picture being displayed is 1.0 at this time, ID 1 is invalidated and 
only the link information of ID 2 is validated. 
[0030] 

In the event control unit 108, based on the search result, an 
action is determined using the related information stored 
beforehand in the related information storage 107, and the 
reproduction control unit 101 displays the information according to 
the details of the determined action in the event control unit 108. 
Here, the material "object2.mpg" defined as action information is 
reproduced. 
[0031] 

As described above, related information according to the 
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display and reproduction status of the video can be displayed by 
using not only the interaction information of a user, but also the 
reproduction state of the video as an enabling condition. 
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